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Abstract 

This paper describes a new method for generating stationary integer-valued time 
series from renewal processes. We prove that if the lifetime distribution of renewal 
processes is nonlattice and the probability generating function is rational, then the 
generated time series satisfy causal and invertible ARMA type stochastic difference 
equations. The result provides an easy method for generating integer- valued time 
series with ARMA type autocovariance functions. Examples of generating binomial 
ARMA(p,p — 1) series from lifetime distributions with constant hazard rates after lag 
p are given as an illustration. An estimation method is developed for the AR(p) cases. 

Keywords: Integer-valued; Autoregressive Moving Average; Renewal Processes. 
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1 Introduction 

Integer-valued time series have a broad range of applications including demographic studies, 
business planning and risk management. Among models developed for them integer- valued 
autoregressive (INAR) ones appear most frequently in the literature, see McKenzie (2003) 
for a review. However, their applicability is limited by their autocorrelation functions always 
being non-negative. More recent approaches include random coefficient processes of Zhang 
et al. (2007), applications of the rounding operator of Kachour and Yao (2009), and the p'th 
order random coefficient autoregressive process of Wang and Zhang (2011). 

We pursue a different method of generating time series by superposing independent 
integer-valued renewal processes, which unlike INAR models can induce negative autocor- 
relation functions. The method was originally proposed by Blight (1989) and developed by 
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Cui and Lund (2009) to generate a variety of time series, Markov and long memory, with 
binomial and other marginals. Following Cui and Lund (2009) we choose renewal processes 
to be stationary from the very beginning to make the generated count process stationary. 
As Blight noticed, its autocovariance generating function can be easily expressed in terms 
of the lifetime distribution. In a couple of examples he computed it had the structure of 
the autocovariance of an autoregressive moving average (ARMA) count series, and he seemd 
to beleive this to be the case whenever the generating function is rational. The question 
reduces to a non-trivial factorization of the numerator of the generating function, which 
Blight performed explicitly in his examples. The main purpose of this paper is to prove 
that the resulting count series is always ARMA if a lifetime distribution is nonlattice and 
has rational probability generating function, see Theorem [TJ Our proof involves palindromic 
polynomials and some subtle properties of probability characteristic functions. As an il- 
lustration, we use lifetime distributions with constant hazard rates after lag p to generate 
binomial ARMAQo, p — 1) count series and study their properties. For p > 2 explicit ARMA 
factorization is not available. 

The paper is organized as follows. Section [2] recalls the construction of renewal count 
processes. In Section [3] we review the definition of ARMA processes and state our main result, 
Theorem [TJ on generation of integer- valued binomial ARMA time series. The proof is given 
in Section H] and in Section Owe apply our theorem to generate binomial ARMAQo, p — 1) 
time series from renewal processes with constant hazard rates after lag p, and show that the 
former possess the p'th order Markov property. Finally, we draw some conclusions. 



2 Renewal count processes 

This section gives a brief review of renewal processes, see Feller (1968) and Ross (1995) 
for a thorough treatment. Let L be a nonnegative random variable, called lifetime, taking 
values in {1, 2, . . .} with P(L = n) = f n and < f\ < 1. Let L , Li, L 2 , ... be independent 
nonnegative integer- valued random variables with L%, L 2 , . . . having the same distribution as 
L. We allow L to have a distribution other than L. Then a renewal is said to happen at 
time n if Lq + Li + ■ ■ ■ + Lk = n for some k > 0. If Lq has unit mass at 0, i.e. Lq = 0, the 
process is called non-delayed or pure, otherwise it is called delayed. 

For a non-delayed process let u n be the probability that a renewal occurs at time n, 
then u n satisfies Uq — 1 and u n = T^I Ujf n -j, n > 1. For a delayed process let v n be 
the probability of a renewal at time n, then u = bo, v n = Y^k=Q^k u n-k ^ or n — ^> wnere 
b n = P(L = n). When L is nonlattice, has finite mean, and b n = fi~ 1 P(L > n), i.e. L has 
the so-called equilibrium or first derived distribution of L, the delayed process is stationary 
with v n = ji^ 1 (Ross, 1995). 

For a stationary renewal process define the following sequence of Bernoulli random vari- 
ables: X t = 1 if a renewal occurs at time t, otherwise X t = 0. It can be shown that X t is 
strictly stationary with 

= cov(X t ,X t+h ) = -{u h ). 
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Many types of integer-valued time series with different marginal distributions can be 
generated by the above model. If we superposition (Cox and Smith, 1954) M independent 
and identical Bernoulli sequences X itt , i = 1, 2, . . . , M and define Y t = J^Zi X *,t t > 0, 
then Y t is strictly stationary with binomial marginal distribution. The autocovariance of Y t 
is 

cov(Y t , Y t+h ) = — [u h ) . 

If L has a constant hazard rate after lag 1 then Y t is Markov. Long memory binomial series 
can also be generated by taking L with finite mean but an infinite second moment (see Cui 
and Lund, 2009, for details). 



3 ARMA processes 

A stationary process X t is called ARMA(p, q) process if for every t 

X t — <P\X t _i — ■ ■ ■ — (f) p X t _ p — Z t + Q\Z t _x + 2 Z t ^2 + • ■ ■ + 6qZ t -q, 

where Z t is a white noise process with variance a 2 . It is convenient to describe ARMA(p, q) 
processes using autocovariance generating functions. In general, if ^(h) is the autocovariance 
function of a stationary process then its autocovariance generating function is defined by 

oo 

G(z) = 7(%" 

h=— oo 

For an ARMAQo, q) process, the classic result shows that 

G{z) = a WM^Y { ] 

where (f)(z) = 1 — (f>±z — faz 2 — • 4>p zP an d 0(z) = 1 + Q\z + 6 2 z 2 + • — h q z q are called the 

autoregressive characteristic polynomial and the moving average characteristic polynomial 
respectively. It can be shown that a stationary process is ARMAQo, q) if its autocovariance 
generating function can be written in the form (13. ip . where both <j)(z) and 6(z) have all their 
roots outside the unit circle (see Priestley, 1981). 

Now let Yt be the integer-valued time series with binomial marginal distributions defined 
in the last section. The probability generating function of lifetime L is defined to be 

oo 
n=l 

As shown by Blight (1989), the autocovariance generating function of Y t is given by 

r(z) _M 1 - F(z)F(l) 
[ } » [l-F(z)][l-F(i)Y 
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where M is the number of independent and identical renewal processes and fi is the mean of 
L. If F(z) is rational, i.e. F(z) = P(z)/Q(z) with P{z) and Q(z) polynomials, then 



M Q(z)Q(±)-P(z)P(l) 

{ ) * uz) - Pizwe - {6 - I] 

Recall that a discrete probability distribution P(L = = Zis called lattice if it is 

supported on a sublattice of integers, i.e. there exists a d > such that YlT=o = ^d) = 1. 
We will show that if L is nonlattice and has a rational probability generating function, then 
(13. 2p can always be factorized as in (13.11) . More precisely, the following is true. 

Theorem 1. Let L be a nonlattice distribution with a rational probability generating function 
F(z) = P(z)/Q(z) , written in lowest terms, and variance a\. Then it represents a causal and 
invertible ARM A process. Moreover, its autocovariance generating function can be factorized 

as G(z) = ^^1) with k = e i^Q2^ , where 4>(z) and 9{z) have all their zeros outside 

the unit circle, and no common zeros. 

Formula for k given in Blight (1989) has a missing factor. We prove Theorem [T] in the next 
section. 



4 ARMA factorization 

In this section we prove our main result, Theorem [U First, recall a result on nonlattice 
distributions, which is crucial to factorizing (I3.2p . Substituting z = e lt into the probability 
generating function F(z) we get exactly the characteristic function x(t) = F(e u ) of the life- 
time distribution L. Of course, any characteristic function has x(0) = 1, which corresponds 
to F(l) = 1. But it turns out that for nonlattice distributions \x(t)\ 7^ 1 on (0, 2ir). In other 
words, for nonlattice lifetime distributions F(z) ^ 1 on the unit circle except at z — 1. The 
following Lemma also shows that in equation (13. 2p Q(z)—P(z) and Q(z)Q(l/z)—P(z)P(l/z) 
have no common zeros on the unit circle except at z = 1. 

Lemma 1. Let f n , n 6 Z be a nonlattice distribution and F(z) be its probability generating 
function. Assume that F(z) is rational and F(z) = P(z)/Q(z) in lowest terms, i.e. P(z) 
and Q(z) are polynomials with no common factors. Then 1 — F(z) and 1 — F(z)F(l/z) have 
only one zero on the unit circle, namely z = 1, and all other zeros are outside the unit circle. 
Moreover, z = 1 is the only common zero of 1 — F{z) and 1 — F(z)F(l/z), as well as of 
Q(z)-P(z) andQ(z)Q(l/z)-P(z)P(l/z). 

Proof. It is proved in Gnedenko and Kolmogorov (1968) that \x{t)\ < 1 on (0, 2tt) except 
when t = if f n is nonlattice. This means that |.F(z)| < 1 for \z\ = 1 and z ^ 1. Hence, on 
the unit circle if z ^ 1, then \l-F(z)\ > |l-|F(z)|| > 0, and l-F(z)F(l/z) = l-\x(t)\ 2 > 0. 
Consequently, 1 — F(z) and 1 — F(z)F(l/z) have no zeros on the unit circle except at z — 1. 
Since F{z)F{l/z) = \P(z)\ 2 /\Q(z)\ 2 , we see that Q(z)Q(l/z) - P(z)P(l/z) > on the unit 
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circle for z ^ 1, which means Q(z)Q(l/z) — P(z)P(l/z) also has only z = 1 as a zero on the 
unit circle. 

By the maximum modulus principle from complex analysis, < 1 for all \z\ < 1. 

Thus |1 - F(z)\ > |1 — 1^(^)11 > for all \z\ < 1. We conclude that except for z = 1 all 
zeros of 1 — F(z) are outside the unit circle. Suppose z* is a common zero of 1 — F(z) and 
1 - F(z)F(l/z) and z* 7^ 1. Then F(z*) = 1 and F(l/z*) = 1. By the above, z* cannot be 
on the unit circle so z* or l/z* is inside of it. But this contradicts < 1 for \z\ < 1. 

Since P(z) and Q(z) have no common factors 1 — F(z) and Q(z) — P{z) have the same 
zeros. From the above we conclude that Q(z) — P(z) have all zeros outside the unit circle 
except for z = 1. Analogously, Q(z)Q(l/z) — P(z)P(l/z) and 1 — F(z)F(l/z) have the same 
zeros. We conclude that Q(z) — P(z) and Q(z)Q(l/ z) — P(z)P(l/z) have no common zeros 
except for z = 1. □ 

Next we investigate the behavior of 1 — F(z) and 1 — F(z)F(l/ z) near their common 
zero z = 1. Applying Taylor series expansion to F(z) around z = 1 one gets F(z) = 
1 + a(z — 1) + b(z — l) 2 + o((z — l) 2 ). Also, expanding l/z around z = 1 we have 

\ = T^TT l - {z - 1) + {z - lf + 0({z - in 

Since z = 1 is a fixed point of l/z we can compose the Taylor expansions: 

F (-) = 1 + a (- - 1) + 6(- - l) 2 + o ((- - l) 2 

\z/ z z \ z 

= l + a [-(z -l) + (z- l) 2 ] + b(z - l) 2 + o((z - l) 2 ) 

= l-a(z-l) + (a + b)(z - l) 2 + o((z - l) 2 ). 

This yields F(z)F (i) = 1 + (a + 26 - a 2 )(z - l) 2 + o((z - l) 2 ). Thus, 1 - F(z)F(l/z) has 
a double zero at z — 1 unless a + 26 — a 2 = 0. But a = F'(l) = E[L] is the first moment of 
lifetime, and 26 = F"(l) = E[L 2 ] — E[L]. Therefore, Var[L] = a + 26 — a 2 is the variance of 
L. For notation, let a\ = a + 26 — a 2 , then it is easy to verify that 

F(z)F (;)=! + ol(z - l) 2 + o((z - l) 2 ). (4.1) 

We now factorize equation (13. 2\\ in the form ( 13. 11) . Recall that we assume F(z) = 
P(z)/Q(z) in lowest terms. Since F(l) = 1 the difference Q(z) — P{z) from the denom- 
inator of (13. 2p has a zero at z — 1. By Lemma [U, Q(^) — -P(z) can be factorized as 

g(z)-P(z) = (l-^)Q(O)0(z), 

where the polynomial <f>(z) has all zeros outside the unit circle. We factored out Q(0) to 
make the constant term of <fi(z) equal to 1 and <f>(z) = 1 — (p\Z — ... — <p p z p for some integer 
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p and constants 0». After dividing out common factors the denominator of ( 13. 2 p takes the 
desired form (see (13. ip ): 

[Q(z)-P(z)}[Q(l/z)-P(l/z)} = 

(l-z)(l-l/^)Q(0) 2 1 J 

It remains to factorize the numerator. Here are two simple but important observations 
concerning Q(z)Q(l/z) — P(z)P(l/z). If a is a zero then 1/a is also a zero, and if a is a 
complex zero then a is also a zero since P(z) and Q(z) have real coefficients. Therefore, 
zeros of Q(z)Q(l/z) — P(z)P(l/z) come in quartets unless some of a, a, 1/a, 1/a coincide. 
The latter occurs in two cases. If a = a then a is real and the quartet reduces to a real pair 
a, 1/a; if a is complex and on the unit circle the quartet reduces to a complex conjugate pair 
a, a. 

In fact, Q(z)Q(l/z) — P(z)P(l/z) is closely related to palindromic polynomials in which 
coefficients read the same from left to right as from right to left. Namely, it becomes a 
palindromic polynomial after being multiplied by the highest power of z. Zeros of real 
palindromic polynomials also generically come in quartets a, a, 1/a, and 1/a. 

Lemma 2. For a nonlattice lifetime distribution with rational generating function F(z) = 
P(z)/Q(z), written in lowest terms, there exist a real polynomial 9(z) with all zeros outside 
the unit circle, and a constant c such that 

Q(z)Q(l/z) - P(z)P(l/z) = c (1 - z)(l - l/z)9{z)9(l/z), 

where 9{z) = 1 + d\Z + 9 2 z 2 + • • • + 9 q z q for some integer q and real constants 9i. 

Proof. Since P(z) and Q(z) have no common factors, 1 — F(z)F(l/z) and Q(z)Q(l/z) — 
P(z)P(l/z) have identical zeros. It follows from (14. ip that z = 1 is a double zero of the 
former and therefore of the latter. In other words, (1 — z)(l — 1/z) can be factored from 
Q(z)Q(l/z) - P(z)P(l/z). Lemma □ tells us that Q(z)Q(l/z) - P(z)P(l/z) has no other 
zeros on the unit circle. Therefore, the remaining factors come in quartets 

(1 - — -^), (1 - =^), (1 - — -), (1 - =-), 

Cij J 3 j 

with aj complex and \aj\ > 1 or pairs 

(i-^)d-ii) 

a k a k z 

with a k real and |ajt| > 1. Define 6(z) to be the product of all factors (1 — —z)(l — =z) 

in the first case, and all factors (1 — -^-z) in the second case. It is clear that 9(z) has real 
coefficients since 

(1 - -z){l - =z) = 1 - (- + =)z + j^Z 2 . 

□ 
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Now we are in a position to prove the main theorem. 



Proof of Theorem [TJ Dividing the numerator and the denominator of equation (13. 2p by 
(1 — z)(l — l/z)Q(0) 2 we get (14. 2[) as the new denominator. For the numerator we apply 
Lemma [2] to get a real polynomial 9 satisfying 

( } V~ (i-.)(i-i)Q 2 (0) ' (43) 

where k is selected to make 9(z) have unit constant term. To compute k we divide both 
sides of (jOJ by Q(z)Q{l/z) and get 



Q(z)Q(l) (1-^)(1-±)Q 2 (0) 

Set z — > 1 on both sides. The lefthand side becomes simply ^ 2 (1)/ Q 2 (l) . The righthand 
side is seen from (14. ip to approach a 2 L /Q 2 {fS). Solving for k yields the desired formula. Since 
k > our Y t is an ARMA time series. By Lemmas [1] and [2, <j>{z) and 9(z) have all zeros 
outside the unit circle and no common zeros. It follows that the corresponding ARMA 
process is causal and invertible (Brockwell and Davis, 1991, Ch.3). □ 



5 Binomial ARMA(£>,£> — 1) time series 

In this section we show how to generate some binomial ARMAQo, p — 1) time series using 
Theorem [U We use distributions with constant hazard rates after lag p as lifetimes. We also 
discuss Markov properties of the generated series. 

If a lifetime distribution has a constant hazard rate after lag 2, the probability mass 
function is P(L = n) = f^r n ^ with < ^3, r < 1 for n > 3. It is clearly nonlattice. It 
can also be shown that the hazard rate is hk = P(L — k\L > k) — (1 — r) for k > 3. The 
probability generating function of L is 

F(z) = Ah + (h - f\r)z + (fs - f 2 r)z 2 } 
[Z) l-rz 

From the last section we know that Q(z) = 1—rz and P(z) = z[fi + (f2 — fir)z + (f 3 — f 2 r)z 2 ]. 
Plugging z — 1/r into P(z) we get P(l/r) = f'3/r 2 ^ 0. Since 1/r is the only zero of Q(z) 
polynomials Q(z) and P(z) have no common factors. 

To factorize the covariance generating function we first compute 

Q(z) - P(z) = 1 - (r + f x )z - (/ 2 - hr)z 2 - (/ 3 - f 2 r)z 3 = (1 - z){\ - faz - foz 2 ), 

with 0x = r + /x - 1, 02 = / 2 r - /a- The numerator of - P(^)P(^- 1 ), has 

a factor (1 — ^)(1 — z -1 ). Besides a double zero at z — 1 there exists another pair of zeros, 
a\ and a^ 1 . Since — P(z)P(z^ 1 ) = (1 — 2;)(1 — 2; _1 )(7r -2 + 7ri + 7r 2; _1 ), where 
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vro = /i(/ 3 - f 2 r), hi = /i/ 2 (l - rf + fj 3 (2 - r) + r(l - ff - /f) + / 2 / 3 , one can solve for 
a\ from 7r z + tti + vr 2 _1 = and get 

_ -tti - y/irf - 4?rg 

tti — . 

27T 

Letting 6 = —a^ 1 one has as in Lemma [2] 

Q(z)Q(z- 1 ) - P(z)P(z- 1 ) = fc(l - z)(l - -)(1 + 0z)(l + Oz- 1 ), (5.1) 

where fc can be found from the formula in Theorem [H or by comparing the constant terms 
on both sides of (15.11) . This yields 

, _ (1 - ft ~ fj - /f) + r 2 (l - ft - ft) + 2/x/ar + 2f 2 f 3 r 

2 + 29 2 - 26 
The autocovariance generating function of Y t is 

Mk (l + 9z)(l + 9z- 1 ) 



G{z) 



[X (1 - <p x Z - <p 2 Z 2 ){l ~ (j>lZ 1 -<p2Z 2 ) 

An AR(2, 1) type stochastic difference equation for Y t is now readily written. 

More generally, suppose L has a constant hazard rate after lag p. Then L has P(L = 
n) = f p +\r n ~ p ~ 1 with < f p +i, r < 1 for n > p + 1. The probability generating function of 
L can be represented by a ratio of two polynomials as follows 

F(z) = f 1 z + f 2 z 2 + ... + f pZ v + f ^— 

1 — rz 

z\h + jh - hr)z + ... + (/ p+1 - / p r)z*] 
1 — rz 

As above, we conclude that P(z) and Q(z) have no common factors since P(l/r) = f p +i/r p ^ 
0. By Theorem [TJ (J(z) — P(z) can be factorized as (1 — z){\ — 4>\z — ... — 4> p z p ) and 
(3(z _1 ) — P(-z _1 ) can be factorized as (1 — z~ r ){l — 4>iz~ l — ... — 4> p z~ p ) for some real 
constants 1; . . . , p . Explicit factorization of Q(z)Q(z~ 1 ) — P(z)P(z~ l ) is no longer possible 
but Theorem [T] still ensures that the stationary time series has ARMAQo, p — 1) structure. 

Now we consider the Markov property for our binomial ARMA(p,p — 1) processes. For 
simplicity we only treat the case p — 2, but the proof is analogous, albeit more cumber- 
some, for general p. The trivariate binomial distribution mentioned below is discussed by 
Chandrasekar and Balakrishnan (2002). 

Theorem 2. Let Y t = J2f=i X i,t, where X i>t , i = {1, . . . , M} are the underlying Bernoulli 
series. Then Y t is a second-order Markov chain, i.e. Y t is independent of [Y t _ 3 , Y t _^ . . . , Y }. 
The vector (Y t , Y t _ 2 ) has the trivariate binomial distribution with the moment generating 
function 

E[e YtSl e Yt - 1S2 e Yt ~ 2S3 ] = (q + ^ Pi e Si + Yl Va^^ + Pi2se Sl e S2 e S3 ) M . (5.2) 

1<«<3 !<«<3 1<i<3 
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Proof. We start by computing the following probabilities for the underlying Bernoulli series 



Pi 


= P(Xi,t 


— i,x ijt - 


-1 = 0, Xij_ 2 


= 0) 


= ^~ 


■'(i-A-^); 


Pl3 


= P(Xi,t 


= i, x iit . 


-1 = 0, X ijt - 2 


= 1) 


= n' 


-7 2 ; 


Pl2 


= P(Xi,t 


— i? x itt . 


-1 = 1, X i>t _ 2 


= 0) 


= V 


■7i(i-/i); 


Pl23 


= P(Xi,t 


— I; x itt . 


-1 = 1, X i>t _ 2 


= 1) 


= fi 


7i/i! 


P3 


= P(Xi,t 


= o,x itt . 


-1 = 0, Xi :t -2 


= 1) 


= V 


-\l-fl-f2); 


P23 


= P(Xi,t 


= o,x itt . 


-1 = 1, X ijt _2 


= 1) 


= V 


'7(1 -/1); 


P2 


= P(Xi,t 


= o,x itt . 


-1 = 1, X; ht -2 


= 0) 


= n' 


"(i-Zi) 2 ; 


1 


= P(Xi,t 


= o,x itt . 


-1 = 0, Xi tt -2 


= 0) 


= 1 


~ E p< ~ E E ^ ~ pu3 



l<j<3 



1<*<3 1<?<3 



The conditional probabilities of X^t can also be explicitly computed. In particular, we 
use that \x = 1 — f\ + 2 ~ r ±ll~* 2 to simplify pi|o,o and get the expression for po|o,o from 
Pi|o,o + Po|o,o = 1- 



Pl|0,0 
Pl|0,l 

Pi|i,o 

Po|0,l 
P0|1,1 

Po|i,o 
Po|o,o 



— l|^i,t-l — 



P(Xi t t — l\Xi it -i — 
P(Xi,t 
P(Xi,t 
P(Xi,t 
P(Xi,t 
P(Xi,t 
P(Xi,t 
P(Xi,t 



l\Xi,t-i 
l\Xi,t~i 

0|X i>t _! 
0|X i>t _! 
0|X i)t _! 



0, -X"i,t— 2 

0, -^i,t-2 

1, -^i,t-2 
1) -^i,t-2 

0, -X"i,t— 2 

1, ^i,t-2 
1) -X»,i-2 
0, -?Q,t-2 



0) = l-r; 

1) = / 2 /(i-/i); 

0) = /1; 

1) = A; 

i) = (i-/i-/ 2 )/(i-/i); 
i) = (i-/i); 
o) = (i-/i); 
0) 



t 1 - E P* - E E P« " ^ 3 ]/[l - 2/x" 1 + = r 

l<j<3 l<j<3 



(5.3) 



Ki<3 



After some algebra one also finds that the probabilities conditioned on X i>t -i, . . . , X^q are 
the same as above, 



P{X l , t \X l x, 



i±-2) 



P(x itt \x itt _i, x ijt _ 2 , x ijt _ 3 . . . , X it o), 



i.e. the underlying Bernoulli series X i>t is a second-order Markov chain. 

Next, we need to find P(Y t \Y t _i, . . . , Y ). To this end, let ej, j = 1, . . . , M, be a zero-one 
vector with three components, and €j(i) denote its «'th component, % = 1, ... ,3. Define a 
set of e/s by 



AYt\Yt- u Yt-2 — s A — (ei, . . . , e M ) 



MM M 

= F t ,5>(2) = ^,^6,(3) = r t _ 2 }> . 
j=l j=l j=l 
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By independence and the Markov property of the underlying Bernoulli series X^t, we have 



P(Y t \Y t _ 1 ,...,Y )= n iii^(Dk 3 (2)^(3), (5.4) 

A e A **in-i.n- a 

where p e .(i)| e .(2),ej(3) can be calculated from (15.31) . Since (15.41) is not affected by {Yts, • • • , Y }, 
we conclude that P(Y t \Y t _i, . . . , Y ) = P(Y t \Y t _ 1 ,Y t _ 2 ), so {Y t } is a second-order Markov 
chain. The formula for the moment generating function E[e YtSl e Yt - lS2 e Yt - 2S3 ] follows from 
(15. 3p by a straightforward computation. □ 

6 Conclusions 

We proved that the renewal process method generates time series with ARMA type autoco- 
variance under fairly broad assumptions. We also gave examples where the generated series 
have the Markov property. As a follow-up, estimation methods for ARMAQo, p — 1) mod- 
els are worth investigating, for example, conditional least squares and maximum likelihood 
methods as in Cui and Lund (2009,2010). On a different note, our method can generate 
periodic count series if one incorporates periodic dynamics into the underlying renewal pro- 
cess. Periodicity is inherent in many physical processes, but periodic count series models are 
scarce in the literature. 
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